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The  Role  of  Flight  Progress  Strips  in  En  Route  Air  Traffic  Control: 

A  Time-Series  Analysis 


In  the  United  States,  there  are  21  en  route  air  traffic 
control  centers  operated  by  the  Federal  Aviation  Ad¬ 
ministration,  primarily  responsible  for  the  safe  and 
efficient  flight  of  high-speed,  high-altitude  aircraft 
between  takeoff  and  landing.  The  airspace  assigned  to 
an  en  route  center  is  divided  into  multiple  sectors, 
each  handled  my  an  individual  controller  or  by  a  team 
of  two  controllers^:  The  radar-side  (R-side)  controller 
is  primarily  responsible  for  observing  the  radar  screen 
and  communicating  with  pilots;  the  data-side  (D- 
side)  controller,  seated  next  to  the  R-side,  assumes 
primary  responsibility  for  preplanning  and  updating 
of  flight  information.  Although  this  general  rule  is 
true  for  most  facilities,  there  are  situations  in  which 
the  responsibilities  of  the  D-side  controller  are  changed 
due  to  R-side  requests. 

Anticipated  automation,  to  be  implemented  in  the 
1990s,  will  drastically  affect  D-side  responsibilities. 
The  first  stage  of  the  automation  is  the  Initial  Sector 
Suite  System  (ISSS).  The  implementation  ofISSS  will 
significantly  change  the  display  of,  and  interaction 


The  FPS  is  a  rectangular  piece  of  paper  that  con¬ 
tains  detailed  flight  information  based  on  the  pro¬ 
jected  altitudes,  routes,  and  arrival  times  submitted  by 
the  pilot  (see  Figure  1 ) .  The  FPSs  are  mounted  in  a  bay 
of  plastic  holders  next  to  the  radar  display.  As  an 
aircraft  enters  a  controller's  sector,  its  corresponding 
FPS  is  moved  from  the  “suspense”  bay  into  the  “ac¬ 
tive”  bay,  which  contains  the  FPSs  of  all  aircraft  in  the 
sector.  As  the  flight  moves  through  the  sector,  the  FPS 
is  continually  updated  by  writing  on  it,  sequencing  it 
among  the  other  strips,  or  it  is  used  as  a  memory  aid 
by  offsetting  (“cocking”)  it  from  the  other  strips. 
Besides  providing  a  legal  record  of  the  flight,  the 
updated  flight  strip  may  also  supply  information  and 
decision  support  for  the  controller. 

Because  of  the  important  role  of  FPSs,  several 
investigators  have  voiced  concern  regarding  their  con¬ 
version  to  an  electronic  format.  For  example,  the 
active  manipulation  of  the  strip  or  deciding  where  to 
insert  a  strip  when  moving  it  from  the  active  to 
suspense  bay  may  force  the  integration  of  the  strip 
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Figure  1.  Example  of  a  flight  progress  strip. 


with,  flight  information  (Ammerman  &  Jones,  1988). 
Flight  information  is  currently  displayed  on  paper 
flight  progress  strips  (FPSs)  that  enable  controllers  to 
update  and  manipulate  flight  information  manually; 
under  ISSS,  flight  information  will  be  displayed  on  a 
computer  screen  as  electronic  flight  data  entries  (FDEs) 
that  will  require  controllers  to  interact  with  flight 
information  using  a  keyboard  and  trackball. 


into  the  existing  situation,  thereby  serving  as  a  memory 
aid  (Hopkin,  1988).  The  organization  of  strips  within 
the  bay  may  also  be  informative  about  the  scheduling 
of  work  tasks  (Shapiro,  Hughes,  Randall,  &  Harper, 
1991),  thus  providing  an  indication  of  impending 
traffic  loads.  Once  the  strips  have  been  moved  into  the 
active  bay,  they  may  be  manipulated  and  sequenced 
among  the  other  strips.  Attention  can  be  drawn  to  a 


^  In  high  traffic  areas  it  is  possible  that  more  than  two  controllers  will  be  responsible  for  a  single  sector. 
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strip  by  offsetting  it  from  the  others  by  lifting  it 
slightly  off  the  board  and  shifting  it  to  the  left  or  right. 
This  activity  may  highlight  an  aircraft  so  that  a  planned 
control  action  will  not  be  forgotten,  thereby  serving  as 
extensions  of  the  controller’s  memory  (Jackson,  1989). 
In  addition,  repeated  marking  on  the  strips  provides 
a  historical  record  of  the  flight  that  may  be  beneficial 
(Hopkin,  1991;  Weston,  1983)  and  this  information 
will  likely  not  be  preserved  in  ISSS. 

On  the  other  hand,  because  flight  strip  manage¬ 
ment  is  clearly  a  time-consuming  activity,  the  time 
spent  maintaining  the  strips  may  be  accompanied  by 
costs  as  well  as  benefits.  Casual  reports  from  several 
controllers  indicate  that  they  do  not  need  FPSs  to 
safely  control  air  traffic.  They  feel  that  the  only  tool 
necessary  for  air  traffic  control  is  the  radar,  and  that 
any  time  spent  away  from  the  radar  is  time  spent  away 
from  their  primary  task. 

With  the  implementation  of  ISSS,  the  FPS  bay  will 
be  replaced  by  a  colored  flight  data  display  that  allows 
computer-controlled  manipulation  of  FDEs.  ISSS  has 
the  capability  to  place  FDEs  into  the  suspense  and 
active  areas  automatically,  based  on  computer  con¬ 
trolled  hand-offs  between  sectors,  and  to  automati¬ 
cally  update  flight  information.  Furthermore,  unlike 
the  current  strip  bay,  the  flight  data  display  is  not 
likely  to  display  all  pending  flights  and  may  not 
provide  a  visible  history  of  aircraft  data  (e.g.,  speed 
and  altitude).  Only  the  most  recent  value  may  be 
stored,  leaving  previous  values  to  be  accessed  by  key¬ 
board  and/or  trackball.  Either  of  these  changes  may 
interfere  with  the  controllers’  memory  for  the  air¬ 
space.  As  these  changes  imply,  the  flight  data  display 
provides  a  smaller  workspace  for  the  FDEs.  If  the 
number  of  FDEs  exceeds  screen  capacity,  constant 
scrolling  may  be  required  to  examine  the  remaining 
FDEs.  In  sum,  automation  will  force  the  controller  to 
interact  less  directly  and,  perhaps  less  often,  with  the 
flight  data. 


Should  interaction  with  FPSs  be  automated? 

The  goal  of  the  current  paper  is  to  provide  empiri¬ 
cal  data  addressing  the  implications  of  FPS  automa¬ 
tion  before  it  takes  place.  The  logic  of  the  current 
approach  can  be  found  in  Vortac  (1993)  and  Vortac, 
Edwards,  Fuller,  and  Manning  (1993).  They  recom¬ 
mended  that  automation  of  task  components  is  likely 
to  be  successful  if  the  task  components  can  be  segre¬ 
gated,  that  is,  if  they  can  be  conducted  in  isolation 
from  the  rest  of  the  system.  Specifying  which  activities 
follow  from  others  may  reveal  activities  that  control¬ 
lers  tend  to  segregate.  If  flight  strip  activity  can  be 
segregated,  it  is  possible  that  automation  will  facilitate 
task  and  cognitive  performance.  On  the  other  hand,  if 
flight  strip  activity  is  inextricably  intertwined  with 
other  controller  functions,  automation  will  probably 
not  enhance  performance. 

This  article  reports  a  time-series  analysis  based  on 
an  observational  study  (Vortac,  Edwards,  Jones,  Man¬ 
ning  &  Rotter,  1993)  in  which  the  behaviors  of 
individuals  and  teams  of  controllers  were  categorized 
“on-line”  while  controlling  simulated  air  traffic  of 
high  and  low  complexity^.  The  behavioral  categories 
covered  the  range  of  activities  that  controllers  perform 
on  the  strips;  looking  at  them,  writing  on  them,  and 
manipulating  them.  Communication  events  and  com¬ 
puter  entries  likely  to  be  related  to  flight  strip  activity 
were  also  recorded.  Time-series  models  were  devel¬ 
oped  to  predict  flight  strip  activity  from  communica¬ 
tion  events,  and  computer  interactions.  Using 
time-series,  rather  than  multiple  regression,  allows  for 
the  prediction  of  an  action  from  an  earlier  action  of 
the  same  type,  while  accounting  for  the  autodepend¬ 
ency  of  errors  inherent  in  any  model  involving  time 
(Ostrom,  1991). 

Controller  teams  are  assumed  to  perform  an  inte¬ 
grated  set  of  activities.  Each  team  member  performs 
control  actions  at  time  t  that  are  contingent  upon  the 
control  action  that  occurred  at  time  ^-1 .  If  this  is  true. 


^Subjects  also  completed  scenarios  of  medium  complexity.  However,  because  Vortac,  Edwards,  Jones,  Manning,  and  Rotter  (1993)  found 
that  medium-complexity  scenarios  have  characteristics  of  both  high-  and  low-complexity  scenarios,  only  the  results  for  high-  and  low- 
complexity  are  presented  here. 
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and  flight  data  activities  are  integrated  among  other 
control  activity,  the  time-series  models  should  show 
communication  events  and  computer  entries  of  each 
controller  in  the  team  predicting  flight  data  activities 
of  the  other  (R-side  interactions  with  flight  data  are 
predicted  by  D-side  activity,  as  well  as  other  R-side 
activity;  D-side  interactions  with  flight  data  are  pre¬ 
dicted  by  R-side  activity,  as  well  as  other  D-side 
activity).  If  this  is  the  case,  the  set  of  FPS  activities 
performed  by  each  controller  should  not  be  automated 
because  each  one  forms  an  integral  part  of  the  whole. 

On  the  other  hand,  if  flight  data  activities  are 
segregated  then  the  time-series  models  should  show 
that  flight  data  activities  of  each  controller  are  pre¬ 
dictable  by  previous  flight  data  activities  performed 
by  a  single  team  member.  For  example,  if  D-side 
activity  is  primarily  predicted  by  R-side  activity  then 
the  D-side  could  be  viewed  as  a  task  component 
controlled  by  the  R-side.  In  this  case,  it  is  likely  that 
the  activities  performed9  by  the  D-side  controller  can 
be  automated  without  any  decrement  in  performance 
for  the  R-side  controller.  This  should  be  the  case  even 
when  the  controller  is  working  singly. 

In  summary,  the  automatic  management  of  FDEs 
will  be  the  main  characteristic  changed  by  the  imple¬ 
mentation  of  ISSS.  This  change  should  have  one  of 
two  consequences:  (1)  automation  may  relieve  con¬ 
trollers  of  time-consuming  activities  that  do  not  en¬ 
hance  job  performance,  or  (2)  automation  of  strip 
activity  may  deconstruct  the  integrated  nature  of  the 
system,  perhaps  by  interfering  with  the  incidental 
cognitive  benefits  accrued  by  physically  interacting 
with  the  strips  (Hopkin,  1991). 

METHOD 

TESTING  SITE  AND  SUBJECTS 

The  study  was  conducted  at  the  Radar  Training 
Facility  (RTF)  at  the  Federal  Aviation  Administration’s 
(FAA’s)  Mike  Monroney  Aeronautical  Center  in 


Oklahoma  City,  Oklahoma.  Ten  full-performance- 
level,  FAA  Academy  instructors  in  the  nonradar  screen 
program  served  as  subjects.  They  had  worked  opera¬ 
tionally  as  en  route  controllers  within  the  last  two 
years  (M  =  7.0  months).  The  subjects  were  familiar 
with  the  airspace,  but  were  not  familiar  with  the 
particular  scenarios  used. 

SCENARIOS 

Five  scenarios  from  each  of  two  levels  of  complexity 
were  selected  from  the  ¥AA  Academy  Scenario  Guide, 
Complexity  is  based  on  the  number  of  departures, 
arrivals,  en  route  aircraft  control  actions,  equipment 
emergencies,  special  flights,  and  other  coordination 
activities,  in  each  scenario^.  The  low-complexity  sce¬ 
nario  lasted  30  minutes,  with  complexity  rating  rang¬ 
ing  from  50-55%;  the  high-complexity  scenario  ranged 
from  90-95%  complex  and  lasted  one  hour.  The 
average  number  of  FPSs  used  were  10.2  and  31.4  in 
low-  and  high-complexity,  respectively.  The  high- 
complexity  scenario  was  comparable  to  a  situation  in 
the  field  where  a  second  controller  (D-side)  would 
likely  provide  assistance. 

In  each  scenario,  the  strip  bay  was  located  to  the 
right  of  the  radar  scope.  The  two  observers  sat  behind 
and  to  the  right  and  left  of  the  controllers  with 
computers  on  their  laps.  Two  “ghost”  pilots  con¬ 
trolled  the  simulated  aircraft  and  another  assumed  the 
communication  functions  of  adjacent  Centers  and 
other  air  traffic  control  facilities. 

APPARATUS 

Verbal  communication  was  recorded  using  a  multi¬ 
track  cassette  recorder.  One  input  channel  included 
the  pilots,  adjacent  Centers,  and  the  controller  (or  the 
R-side  member  of  a  team,  with  the  D-side  communi¬ 
cations  recorded  on  a  separate  channel).  In  addition, 
each  observer  was  recorded  on  their  own  input  chan¬ 
nel,  allowing  them  to  annotate  their  event  recordings. 


^  Complexity  was  measured  using  the  complexity  worksheet  found  in  the  FAA’s  Instructional  Program  Guide  (Appendix  B,  Section  3,  Phase 
8A  for  nonradar) .  Complexity  was  computed  in  the  following  way:  departures  got  5  points;  arrivals,  en  route  aircraft  needing  a  control  action, 
emergencies  and  radio  failures  each  received  4  points;  special  flights  got  3  points;  en  route  aircraft  not  needing  a  control  action  got  2  points; 
and  1  point  for  each  additional  coordination  action  (e.g.,  point-to-point  flight).  More  points  indicates  greater  complexity.  We  selected 
scenarios  from  low  and  high  complexity,  corresponding  to  series  8  and  9,  and  24  to  29,  respectively,  in  the  Guide. 
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A  video  camera  was  focused  on  the  strip  bays  to 
record  when  writing  and  manipulating  took  place. 
Two  notebook  computers  were  used  for  the  on-line 
data  collection  by  the  two  observers.  The  time-lines 
generated  by  the  observers  were  corrected  off-line, 
due  to  an  occasional  misclassification,  using  the  audio 
and  video  tapes. 

PROCEDURE 

Each  subject  participated  twice;  once  as  an  indi¬ 
vidual  and  again  as  the  R-  or  D-side  member  of  a  team. 
Teams  participated  approximately  one  month  after 
the  individuals  were  completed.  On  the  last  three  days 
of  individual  controller  participation,  inter-rater 
reliabilities  were  calculated  (Low  =  .83,  High  =  .75). 
Because  of  the  high  reliability,  the  teams  were  coded 
using  only  two  observers:  one  for  the  R-side  and  one 
for  the  D-side. 

Each  individual  and  team  completed  a  counterbal¬ 
anced  sequence  of  scenarios.  To  ensure  the  same 
experimental  history,  each  team  member  had  com¬ 
pleted  the  same  sequence  of  scenarios  when  run  indi¬ 
vidually.  Subjects  never  controlled  the  same  scenario 
twice. 

Upon  entering  the  RTF,  subjects  first  completed  a 
brief  background  sketch.  They  were  then  given  the 
opportunity  to  organize  the  strip  bay  in  preparation 
for  the  scenario.  Subjects  were  provided  with  all  the 
strips  for  the  problem  at  this  time  and  were  instructed 
to  control  traffic  as  they  would  in  the  field. 

Each  experimental  session  lasted  approximately  3 
hours.  Break  periods  between  scenarios  were  approxi¬ 
mately  20  minutes. 

BEHAVIORAL  CATEGORIES 

For  each  scenario,  the  communication,  FPS,  and 
computer-related  events  listed  in  Table  1  were  re¬ 
corded,  yielding  a  time-indexed  behavioral  record.  As 
shown  in  Table  1,  each  main  event  listed  in  the  left- 
hand  column  represents  a  composite  of  the  individual 
actions  listed  in  the  right-hand  column. 

Communication  events  were  categorized  into  Con¬ 
troller  Commands  (Ccom),  Controller  Queries 
(Cquery),  Pilot  Requests  (Preq),  Sector  Transitions 
(Sector),  and  Team  Communication  (Team).  FPS 
activities  were  categorized  into  Looking  at  an  FPS 
(Look),  Writing  on  an  FPS  (Write),  and  Manipulat¬ 


ing  an  FPS  (Manip).  Computer-related  activities  were 
categorized  into  Updating  the  Computer  Database 
(Update),  Obtaining  Information  From  the  Computer 
Database  (Info),  using  the  computer  to  aid  in  Conflict 
Detection  (Conflict),  and  using  the  keyboard  or 
trackball  to  initiate  the  Hand-off{}:iovv)  of  an  aircraft 
to  an  adjacent  sector  or  facility. 

Communication  Events.  A  Ccom  was  a  command 
issued  by  the  controller  to  a  pilot,  whereas  a  Cquery 
was  a  controller-initiated  request  for  information  from 
the  pilot  (“What  is  your  altitude?”).  A  Preq  was  a 
pilot-initiated  request  to  the  controller  (“Can  I  fly 
direct  to  Tulsa?”).  Sector  involved  interactions  be¬ 
tween  the  controller  and  adjacent  sectors  as  well  as 
other  air  traffic  control  facilities,  primarily  when 
aircraft  were  entering  or  exiting  the  sector.  When  a 
team  participated,  verbal  communications  between 
team  members  were  also  recorded  (Team). 

FPS  Activities.  The  Look  category  included  looks 
at  both  the  active  and  suspense  bays.  Because  a  look 
obviously  precedes  other  FPS  activities,  this  category 
included  only  those  looks  that  were  not  immediately 
followed  by  writing  or  manipulating.  When  coding 
teams,  a  look  recorded  on  the  D-side  indicated  a  look 
at  the  radar  scope,  whereas  a  look  on  the  R-side 
indicated  a  look  at  the  strips.  Multiple  looks  indicate 
that  the  controller  looked  away  and  then  returned  to 
look  at  the  strips  or  the  radar.  The  Write  category 
included  both  verifications  (e.g.,  a  check  mark  placed 
by  the  altitude  entry  upon  initial  contact),  and  a 
change  (e.g.,  crossing  out  and  updating  strip  informa¬ 
tion).  The  Manip  category  included  any  physical 
movement  of  the  strip. 

Computer-Related  Activities.  The  computer  that 
controlled  the  traffic  simulation  generated  a  summary 
of  all  computer-related  control  actions.  From  this 
summary,  four  additional  computer-entry  control 
actions  were  added  to  the  data.  The  Update  category 
indicated  that  the  controller  updated  flight  informa¬ 
tion  in  the  computer  database,  whereas  the  Info 
category  indicated  that  flight  information  was  re¬ 
trieved  from  the  database.  The  Conflict  category 
indicated  the  placing  of  a  circle  around  an  aircraft’s 
location  on  the  radar,  visually  representing  a  “bubble” 
of  airspace  surrounding  that  aircraft.  The  most  im¬ 
portant  job  in  en  route  air  traffic  control  is  to  main- 
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Table  1 

Behavioral  Categories  and  their  Individual  Actions 


Main  Event 


Individual  Actions 


Controller  Command  (Ccom) 


■  Controller  Query  (Cquery) -- 

I  Pilot  Request  (Preq) - 

Sector  Transitions  (Sector)  — 

Team  Communication  (Team) 

Look  (Look) - 

Write  (Write) - 

i 

Manipulate  (Manip) - 


Update  Computer  (Update)  — 
Obtain  Computer  Info.  (Info) 
Conflict  Detection  (Conflict) 
Computer  Hand-off  (Hoff)  — 


route  change,  speed  change,  altitude  change,  providing 
information  (e.g.,  altimeters,  VFR  traffic),  issuing 
clearance,  other 

aircraft  speed,  altitude,  route,  other 

route  change,  speed  change,  altitude  change,  providing 
information  (e.g.,  altimeters,  VFR  traffic),  other 

turnover  of  control  to  adjacent  sector,  departure 
clearance,  initial  contact  within  sector 

verbal  and  nonverbal  communication  between  team 
members 

at  active  bay,  at  suspense  bay 

verification  of  FPS  information,  change  of  FPS 
information 

move  FPS  from  suspense  to  active  bay,  sequence  FPSs, 
offset  FPS,  flatten  (undo  offset)  FPS,  remove  FPS  from 
bay 

input  assigned  altitude,  input  interim  altitude,  change 
route 

examine  an  aircraft's  flight  plan,  display  an  aircraft's 
projected  route  on  the  radar  scope 

display  a  circle  with  a  radius  of  five  miles  of  airspace 
around  a  specified  aircraft 

receive  control  from  adjacent  sector  or  facility 
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tain  appropriate  separation  between  all  aircraft;  the 
circle  represented  the  boundary  for  minimum  separa¬ 
tion.  Hand-ofFs  (Hoff’s)  are  initiated  verbally  and  by 
computer.  When  an  aircraft  approaches  the  sector 
boundary  or  is  to  be  transferred  to  another  facility 
(e.g.,  approach  control),  the  pilot  is  notified  verbally 
and  a  sequence  of  keys  is  pressed  to  notify  the  adjacent 
facility  of  the  Hoff. 

Each  of  the  above  categories  were  used  as  predictors 
of  flight  strip  activities.  For  controller  teams,  some  of 
the  abbreviated  categories  were  preceded  by  an  ‘R’  or 
‘D’  indicating  the  controller  responsible  for  the  activ¬ 
ity.  For  example,  RwRITE  represented  the  R-side  con¬ 
troller  writing  on  the  strips  and  Dwrite  represented 
the  D-side  controller  writing  on  the  strips.  Categories 
that  were  not  preceded  by  an  'R’  or  *D’  indicated  that 
one  controller  was  responsible  for  that  activity.  For 
example  Sector  was  done  by  only  the  R-side  control¬ 
ler. 

RESULTS  AND  DISCUSSION 

Autoregressive  time-series  models  were  used  to 
predict  flight  strip  activities  (i.e..  Look,  Write,  and 
Manip).  With  these  types  of  models,  complications 
arise  when  pooling  across  subjects  to  estimate  the 
overall  time-series  regression  model.  Various  methods 
of  estimating  the  pooled  regression  model  exist.  The 
Seemingly  Unrelated  Regression  (SUR)  was  chosen 
because  it  can  be  used  when  pooling  across  subjects  or 
when  lagged  dependent  measures  exist  in  the  time- 


series  model  (see  Appendix  for  additional  details).  For 
pragmatic  reasons,  the  forward  selection  procedure 
recommended  by  Gallant  and  Jorgenson  (1979)  was 
used  with  the  restriction  that  individual  variables  not 
explaining  at  least  four  percent  of  the  total  variance 
were  eliminated  from  the  models. 

First,  the  low-  and  high-complexity  scenarios  were 
divided  into  90-second  time  intervals.  The  number  of 
responses  for  an  FPS  activity  during  interval  t  ( T^)was 
predicted  from  the  number  of  responses  for  the  other 
/(variables  from  that  interval  and  the  number  of 

responses  from  the  previous  interval  ( ^).  That  is, 

=  Y^j).  SUR  was  used  to  develop 

separate  models  for  each  of  the  single  and  team  con¬ 
ditions.  Residuals  were  examined  for  each  model  and 
indicated  that  the  data  were  well-fit  by  the  model. 
Predictors  are  listed  in  order  of  contribution  to  the 
model.  The  models  are  divided  into  the  categories. 
Look,  Manip,  and  Write.  Each  category  will  be 
discussed  in  turn. 

The  adjusted  R-^  represents  the  proportion  of  vari¬ 
ance  accounted  for  by  the  model,  corrected  for  the 
number  of  predictors  included  in  the  model.  For  each 
model,  the  degrees  of  freedom,  adjusted  i?,  and 
corresponding  /(-value  are  reported.  No  reliable  pre¬ 
dictors  were  found  for  those  models  containing  only 
an  intercept. 

Look.  As  shown  in  Table  2,  looking  was  not  pre¬ 
dictable  in  either  the  single  or  team  situations.  Al¬ 
though  three  out  of  the  four  /(-values  were  significant, 
indicating  above  chance  predictability,  only  the  high- 


Table  2 


Time-series  Models:  LOOK 


Model 

df 

R^adj 

P< 

SINGLES 

LOW: 

LooKt  =  2.07  -  .30  SECTORt 

1 

.03 

8.06 

.0045 

HIGH: 

LooKt  =  1 .34  -F  .20  LooKt-1 

1 

.04 

16.59 

.0001 

TEAMS 

LOW: 

RlOOKt  =  .75  +  .17  lEAMt 

1 

.03 

3.53 

.0603 

HIGH: 

RtooKt  =  .38  +  .26  RLOOKt-1  +.12  TEAMt 

2 

.11 

21.27 

.0001 
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Tabic  3 

Time-series  Modek:  MANIP 


Model 

df 

It^adj 

fx 

SINGLES 

LOW: 

MANiPt  =  .44  +  .46  SEcroRt 

1 

.15 

35.27 

.0001 

HIGH: 

MANiPt  =  .39  +  .28  WRiTEt  +  .25  SEcroRt 

2 

.16 

75.16 

.0001 

TEAMS 

LOW: 

Rmanipi  =  .1 8  +  .37  RMANiPt-1 

1 

.12 

11.58 

.0007 

HIGH: 

DMANIPt  =  1 .1  1 

RMANIPt  =.16  +  .54  RMANIPt-1 

1 

0 

.29 

65.30 

.0001 

DMANIPt  =  1 .44  +  .46  SECTORt 

1 

.05 

9.51 

.0020 

complexity  Rlook  model  accounted  for  over  4%  of 
the  variance.  This  model  indicates  that  when  the 
traffic  situation  is  complex,  the  R-side  controller  is 
likely  to  look  at  the  strips  when  communicating  with 
the  D-side  controller.  Also,  if  the  R-side  has  looked  at 
the  strips  once,  he  or  she  is  likely  to  look  again.  This 
is  the  only  Look  model  that  accounts  for  over  ten 
percent  of  the  variance.  Because  no  general  conclu¬ 
sions  can  be  reached  by  imposing  meaning  on  one 
model,  the  Look  models  will  not  be  discussed  further. 
As  indicated  previously,  Dlook  is  not  included  in  the 
table  because  it  indicated  a  look  to  the  radar  scope  and 
is  therefore  not  considered  a  flight  strip  activity. 

Manip.  The  Manip  models  are  shown  in  Table  3. 
Although  Manip  is  predicted  better  than  Look,  the 
proportion  of  variance  accounted  for  by  each  Manip 
model  is  limited.  Of  these  models,  Rmanip  in  the 
teams-high  condition  accounts  for  the  largest  propor¬ 
tion  of  variability.  The  inclusion  of  Rmanip  as  the  only 
predictor  in  the  teams-high  and  -low  conditions  indi¬ 
cates  that  the  best  predictor  of  an  R-side  manipulation 
is  another  R-side  manipulation.  It  would  appear  that 
when  the  R-side  left  the  radar  to  manipulate  the  strips, 
he  or  she  took  one  or  more  actions  with  them.  In  the 
teams-high  condition,  there  is  no  agreement  about 


what  other  activity  is  a  predictor,  other  than  Rmanip^ 
Apparently  a  myriad  of  other  activities  covary  with 
Rmanip,  but  none  sufficiently  often  enough  to  be 
included  as  a  predictor. 

Sector  is  the  only  predictor  in  the  singles-low  and 
D-side  high-team  models,  and  Sector  is  accompa¬ 
nied  by  Write  in  the  singles-high  model.  However, 
neither  Sector  nor  Write  is  included  in  either  Rmanip 
model,  suggesting  that  the  FPS  activities  performed 
by  the  R-side  controller  are  qualitatively  different 
than  those  performed  by  the  D-side  or  by  the  control¬ 
ler  working  singly.  Rather  than  being  responsive  to 
the  actions  of  the  R-side  controller,  which  was  seen 
above  for  Rmanip,  D-side  controllers  are  more  respon¬ 
sive  to  the  characteristics  of  the  traffic  situations,  that 
is,  aircraft  entering  and  leaving  the  sector. 

Write.  In  contrast  to  other  FPS  activities.  Writing 
on  FPSs  is  highly  predictable.  The  average  adjusted 
R*^,  shown  in  Table  4,  is  much  higher  for  these  models 
than  for  either  the  Look  or  Manip  models  (.34  vs.  .05 
and  .15,  respectively) . 

Inspection  of  these  models  suggests  that  there  may 
be  a  common  subset  of  predictors  that  can  account  for 
writing  on  the  strips.  Write  (performed  by  an  indi¬ 
vidual  or  R-side  team  member)  is  in  five  of  the  models 
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and  Sector  is  in  four.  However,  there  are  several 
other  predictors,  which  when  accompanied  by  Sec¬ 
tor  and/or  Write  may  significantly  contribute  to  the 
models'  predictability  (e.g.,  CcoM,  Update,  Manip, 
etc.).  t 

In  addition  to  Sector  and  Write,  Ccom  is  in¬ 
cluded  in  two  of  the  teams  models.  Futhermore,  the 
combination  of  these  three  predictors  represents  a 
subset  of  all  of  the  predictors  in  the  teams  models  with 
only  Rinfo  remaining.  Note  that  Ccom  does  not  show 
up  as  a  predictor  in  either  of  the  single  controller 
models,  perhaps  because  CcOM  does  not  contribute  to 
the  predictability  of  writing  on  flight  progress  strips. 
However,  this  seems  unlikely  given  its  presence  in  the 
teams  models.  Another  possibility  is  that  CcOM 
covaried  with  other  predictors  and  was  selected  out  of 
by  the  forward  selection  procedure. 

With  these  possibilities  in  mind  we  examined  the 
singles  data  more  closely  to  determine  whether  CcOM 
was  closely  competing  for  inclusion  in  the  models. 
This  inspection  indicated  that  CcoM  covaried  with 
many  of  the  predictors  that  are  included  in  the  single 
controller  models.  Specifically,  CcoM  was  excluded 
by  the  forward  selection  procedure  in  favor  of  another 
predictor  by  an  average  i?^of  .02.  Thus,  when  predict¬ 
ing  writing  on  flight  strips  for  individuals  and  teams 
of  controllers,  the  most  practical  and  parsimonious 
solution  may  be  the  following  common  subset  of 
predictors: 

Write  =  Sector  +  Write  ,  +  Ccom  . 

t  t  t-i  t 

This  model  was  compared  to  each  of  the  Write 
models  in  Table  4,  without  respect  to  predictor  order, 
and  found  to  account  for  as  much  variability  as  all  but 
one  of  the  original  time-series  models.  Thus,  the 
subset  model  does  provide  a  parsimonious  solution, 
sacrificing  little  predictability,  and  will  therefore  be 
the  focus  of  the  following  discussion. 

Beginning  with  D-side  writing,  for  both  high  and 
low  complexity,  the  common  subset  model  is  identi¬ 
cal  to  the  original  Dwrite  models.  Thus,  D-side 
writing  can  be  predicted  from  the  subset  model’s  two 
R-side  activities  and  sector  transitions. 

Substituting  the  subset  model  in  the  singles-low 
condition  replaces  Update  with  a  combination  of 
Ccom  and  Write  but  does  not  significantly  change 


the  adjusted  P?,  Similarly,  the  subset  model  did  just  as 
well  as  the  original  model  at  predicting  Rwrite  in  the 
teams-low  condition,  in  this  case  by  replacing  Rinfo 
with  a  combination  of  Sector  and  CcoM:  the  .04 
change  in  i?^is  not  significant.  In  addition,  substitut¬ 
ing  the  subset  model  did  not  change  the  adjusted  F? 
for  the  teams-high  R-side  condition  (the  .01  change  is 
not  significant).  Thus,  in  singles-low,  teams-low  and  - 
high  R-side  conditions,  the  common  subset  model  pre¬ 
dicted  writing  as  well  as  either  of  the  original  models. 

In  the  three  models  mentioned  above  (singles-low; 
teams-low  R-side;  teams-high  R-side)  the  subset  model 
adds  one  or  two  predictors  not  included  in  the  original 
model.  Although  models  with  fewer  predictors  (like 
the  original  models)  are  generally  preferred  to  mul¬ 
tiple-predictor  models,  especially  when  they  account 
for  the  same  proportion  of  variability,  the  multiple- 
predictor  subset  model  is  preferred  because  it  is  has 
the  most  practical  value.  Moreover,  the  Rwrite  single¬ 
predictor  model,  in  the  teams-high  R-side  condition, 
lacks  predictive  value  because  it  does  not  indicate 
what  led  the  R-side  controller  to  begin  the  sequence  of 
writing  activity.  For  this  reason,  the  subset  model 
provides  more  information  and  is  more  useful  than 
the  original  model,  although  the  latter  could  be  used 
without  loss  in  predictability. 

The  final  Write  model  is  the  singles-high  condi¬ 
tion.  The  subset  model  replaces  Manip  with  Ccom 
but  again  does  not  impact  the  adjusted  F?,  Thus,  in  no 
case  does  the  substitution  of  the  subset  model  signifi¬ 
cantly  reduce  the  predictability  of  writing  on  the  FPSs. 

Segregation,  The  inclusion  of  Manip  as  a  predictor 
of  Write  in  the  original  singles-high  model  supports 
the  idea  that  once  controllers  switch  to  the  radar,  they 
tend  to  perform  FPS  activities  in  clusters.  This  is  also 
shown  by  comparing  the  singles-low  and  singles-high 
models  in  the  Manip  category  (see  Table  3).  Write  is 
not  included  in  the  singles-low  model,  but  is  the  best 
predictor  in  the  singles-high  model.  This  clustering  of 
FPS  activities  as  complexity  increases  supports  the 
idea  that  individual  controllers  tend  to  segregate  flight 
strip  activities  from  radar  activities,  and  to  perform 
those  activities  in  clusters  (see  also  Vortac,  Edwards, 
Jones,  Manning,  &  Rotter,  1993;  Vortac,  Edwards, 
Fuller,  &  Manning,  1993).  Perhaps  this  is  why  many 
of  the  individual  controllers  in  the  high-complexity 


8 


The  Role  of  Flight  Progress  Strips 


Table  4 

Time-series  Models:  WRITE 


Model 

df 

/?^adj 

P< 

SINGLES 

LOW: 

WRITEt  =  1  .49  +  .68  SeCTORt  +  .58  UPDATEt 

2 

.18 

46.36 

.0001 

SUBSET: 

WRITEt  =  .91  +  .57  SECTORt  +.19  CcOMt  +.19  WRITEt-1 

3 

.19 

50.86 

.0001 

HIGH: 

WRITEt  =  1 .23  +  .29  MANiPt  +  .28  Writei-I  +  .27  SEcroRt 

3 

.23 

118.86 

.0001 

SUBSET: 

WRITEt  =1.11  +.12  CcOMt  +  .29  WRITEt-1  +  .40  SECTORt 

3 

.19 

90.96 

.0001 

TEAMS 

LOW: 

RwRITEt  =  .26  +  .55  RwRITEt-1  +  .94  RiNFOt 

2 

.38 

48.30 

.0001 

SUBSET: 

RwRITEt  =  .03  +  .62  RwRITEt-1  +  .20  SECTORt  +  .04  RcCOMt 

3 

.34 

42.11 

.0001 

LOW: 

DwRiTEt  =  .92  +  .56  RccoMt  -  .67  RwRiTEt  +  .56  SEcroRt 

3 

.48 

75.21 

.0001 

SUBSET: 

DwRiTEt  =  .92  +  .56  RccoMt  -  .67  RwRiTEt  +  .56  SEcroRt 

3 

.48 

75.21 

.0001 

HIGH: 

RWRITEt  =  .24  +  .60  RWRITEt-1 

1 

.36 

89.21 

.0001 

SUBSET: 

RwRITEt  =.12  +  .60  RwRITEt-1  +  .08  SECTORt  -.002  CcOMt 

3 

.35 

90.29 

.0001 

HIGH: 

DwRiTEt  =  1 .49  +  .41  RccoMt  -  .50  RwRiTEt  +  .48  SEcroRt 

3 

.38 

99.22 

.0001 

SUBSET: 

DwRiTEt  =  1 .49  +  .41  RccoMt  -  .50  RwRiTEt  +  .48  SEcroRt 

3 

.38 

99.22 

.0001 

scenario  requested  D-side  assistance;  They  felt  that 
they  did  not  have  time  to  perform  the  strip  activities 
and  when  they  took  the  time  they  tried  to  catch  up. 
For  these  controllers  it  became  increasingly  difficult 
to  switch  roles  between  the  FPSs  and  the  radar, 
whereas  within  a  team  these  roles  are  naturally  sepa¬ 
rated. 

Computer  interactions  also  appear  to  change  as  a 
function  of  complexity.  Although  these  predictors 
only  entered  into  three  of  the  models  (Manip:  teams- 
low  R-side;  Write:  singles-low,  teams-low  R-side), 
they  always  appeared  in  low-complexity  situations. 
Controllers  may  segregate,  or  severely  restrict,  un¬ 
necessary  computer  interactions  when  the  traffic  situ¬ 
ation  gets  complex.  It  is  possible  that  performing  any 
control  activity  not  directly  associated  with  observ¬ 
ing  the  radar  might  reduce  performance  in  complex 
situations. 


Another  indicator  that  controllers  tend  to  segregate 
flight  strip  activities  is  that  D-side  activites  are  never 
included  as  a  predictor.  In  all  situations,  R-side  activi¬ 
ties  or  computer  interactions  predicted  both  R-  and 
D-side  activities.  This  suggests  that  D-side  activities 
truly  support  actions  performed  by  the  R-side. 

Single  versus  Team  activities.  Once  again,  the  single 
controller  models  and  the  D-side  controller  models 
share  several  predictors.  For  a  given  level  of  complex¬ 
ity,  the  D-side  models  use  the  same  set  of  predictors  as 
the  single  models.  (Recall  that  Rccom  and  Rwrite  in 
the  Dwrite  low  model  replaces  Update  in  the  singles- 
high  model  without  any  loss  of  predictability.) 

The  subset  model  can  also  be  applied  to  the  singles- 
high,  singles-low,  and  D-side  high  Manip  models.  In 
each  case,  Manip  is  triggered  by  some  configuration  of 
the  subset  model  predictors.  R-side  manipulations, 
on  the  other  hand,  were  not  predicted  by  any  of  the 
subset  model  predictors. 
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CONCLUSIONS 

The  aim  of  this  study  was  to  examine  the  current 
role  of  FPSs  in  en  route  air  traffic  control  by  determin¬ 
ing  which  control  actions  reliably  lead  to  FPS  activity. 
The  most  predictable  flight  strip  activity  was  writing, 
however,  manipulating  flight  strips  was  also  modestly 
predictable.  There  were  generally  three  things  that  led 
to  writing  on  a  flight  strip:  (1)  a  sector  transition,  (2) 
a  controller  command,  and  (3)  prior  writing  on  the 
strips. 

Flight  strip  activities  are  not  as  integrated  into  the 
overall  control  of  air  traffic  as  one  might  suspect.  The 
activities  performed  by  the  R-side  controller  pre¬ 
dicted  the  strip  activities  of  both  the  R-  and  D-side 
controllers.  When  a  team  was  responsible  for  a  sector, 
a  D-side  activity  never  entered  into  any  models.  R- 
side  control  actions  influence  flight  strip  activities  of 
both  the  R-  and  D-side,  but  D-side  control  actions 
rarely  influence  flight  strip  activities  performed  by  the 
R-side.  Thus,  with  regard  to  flight  strip  activities, 
when  two  controllers  are  responsible  for  a  single 
sector,  their  relationship  is  not  one  of  mutual  ex¬ 
change  as  “team”  implies.  Consequently,  it  is  possible 
that  flight  strip  activities  performed  by  the  D-side 
controller  can  be  automated  without  any  decrement 
to  R-side  performance  (Vortac,  1992).  On  the  other 
hand,  if  the  team  performed  a  more  integrated  set  of 
flight  strip  activities,  this  would  not  be  the  case. 

Together  with  the  cognitive  and  performance  analy¬ 
sis  of  Vortac,  Edwards,  Fuller,  and  Manning  (1993), 
the  above  conclusions  imply  that  automation  of  the 
FPS  activities  may  enable  an  individual  controller  to 
control  the  same  amount  of  aircraft  with  less  effort, 
and  therefore  be  better  prepared  to  manage  the  in¬ 
crease  in  air  traffic  expected  in  the  coming  decades. 
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Appendix  A 

Autoregressive  time-series  regression  models  differ  from  basic  regression  models  in  two 

A  A 

fundamental  ways:  1)  time  is  included  in  the  model  (i.e.,  Yt  =  a  +  bXt  +  e/),  and  2)  the  error  terms 
need  not  be  independent,  as  they  are  assumed  to  be  in  the  basic  regression  model. 

A 

According  to  Ostrom  (1991),  the  dependence  in  the  error  terms  does  not  bias  the  estimates  a 

A  A  A 

and  b  ,  but  does  bias  the  variance  estimates  of  a  and  b,  thereby  affecting  any  test  of  significance. 

Further,  Ostrom  (1991,  p.22)  states  that  the  variances  of  the  estimates  are  typically  underestimated 

when  an  autoregressive  process  is  present.  Thus,  test  statistics  on  the  estimates  are  usually  liberal 

and  overrepresent  the  fit  of  the  model  when  non-autoregressive  time-series  models  are  used.  This 

2 

means  that  when  the  autoregressive  process  is  not  taken  into  account,  the  R  values  produced  by 
the  models  are  typically  too  high  and  the  probability  of  rejecting  the  model  is  greater  than  the 
predetermined  by  the  experimenter. 

Additional  complications  arise  when  pooling  across  subjects  to  estimate  the  time-series 
regression  model.  Various  methods  of  estimating  the  pooled  regression  model  exist  and  the 
selected  model  of  estimation  must  take  into  account  the  random  nature  of  subjects  (Sayrs,  1989). 
Seemingly  Unrelated  Regression  (SUR)  is  a  random  coefficient  regression  model  that  allows  the 
relationship  between  the  criterion  and  predictors  to  differ  across  subjects  while  remaining  constant 
for  a  given  subject  (Zellner,  1962).  SUR  accommodates  individual  subjects  by  allowing  a  separate 

A 

a  for  each  subject.  We  used  SUR  in  our  analyses  for  this  reason. 

Finally,  because  the  time-series  models  also  include  lagged  values  of  the  dependent  variable 

A  A  A  A  A 

(i.e.,  Yt  =  a  +  blXt  +  blYt-l  +  cr  ),  the  parameter  estimates,  a  and  b,  may  be  inconsistent 

estimators  of  the  population  regression  weights  (Ostrom,  1991).  Fortunately,  SUR  adjusts  for 

lagged  dependent  variables,  thereby  avoiding  the  inconsistent  estimator  problem  (Sayrs,  1989). 

A  forward  selection  procedure  was  used  to  determine  the  best  predictor  models  for  each  of  the 

dependent  variables.  However,  the  standard  forward  selection  procedure  cannot  be  used  because  it 

does  not  take  into  account  the  correlation  in  the  errors.  To  account  for  this  potential  problem,  the 

forward  selection  procedure  used  here  is  based  on  Gallant  and  Jorgenson  (1979).  They  found  that 

the  least  squares  difference  between  the  full  and  restricted  model,  adjusted  for  the  correlation 

2 

among  the  errors,  is  asymptotically  a  %  with  degrees  of  freedom  equal  to  the  difference  in  the 
number  of  parameters  estimated  in  the  full  and  restricted  models  (SAS,  1988). 


A1 
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